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ABSTRACT 

Models of man making predictions of future states of discrete linear dynamic 
systems are considered. The task Is forced-pace, but the pace Is slow enough to 
eliminate the effects of reaction time and neuromuscular lag. The best of the several 
models considered includes the constraints of limited memory and observation noise. 

INTRODUCTION 

Many human activities depend on the ability to make predictions. We usually 
are fairly accurate when making the simple predictions required for such tasks as 
walking or opening a door which depend on a (perhaps unconscious) prediction of fut- 
ure positions of one’s legs, arms, etc. However, as we try to predict further into 
the future and/or one's understanding of or experience with the process decreases, 
our predictive abilities degrade. For example, our abilities are somewhat limited 
when trying to predict the effect today’s technology will have in the next century. 

The Improvement of man's ability to predict has paralleled the development of 
civilization. fconomic, political, and technological progress is dependent on the 
confidence in the future that comes with the ability to make predictions. The fur- 
ther Into the future that ccn be acceptably predicted, the better that Investments, f 

policies, and strategies can be planned. 

This paper considers man making predictions of future states of discrete linear 
dynamic systems. Several models of the human In this task are presented. Two of 
the models, which assume simple extrapolation strategies, do not predict as well as 
the human. Two other models, which utilize two methods of system Identification, 
predict much better than the huoan. A fifth model, which Is basically a linear 
regression system Identifier with a limited memory and noisy observations, matches 
human performance quite well. These models and others are used to discuss the 
limitations Imposed on hunan predictive abilities by physiological and cognitive con- 
straints. The effect of these constraints is related to the distance Into the future 
that the human attempts to predict. 
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and the derivatives noted In X were approximated using one-sided difference equations. 
Amplitude x Is on the horizontal scale and time Increases downward on the vertical scale. 
The points displayed are at • 1.0 units apart. 

The subject viewed the last ten points of system output. is task was to pre- 
dict the eleventh point, the horizontal position of which he uontrolled with a poten- 
tiometer. The horizontal line at the top of the display represented the time in which 
the prediction had to be completed. The length of the line decreased as the time re- 
maining decreased. When the length of the bar went to zero, the subject's prediction 
was read by the computer and output on paper tape along with the optimal prediction 
and the actual next point. All the points on the display (with the exception of the 
subject's prediction) then shifted one unit up the vertical scale and a new point ap- 
peared below these points representing the actual point which the subject has just 
tried to predict. Thus, assuming that the subject had not moved his potentiometer 
during the updating Interval, he saw his prediction error as the difference In hor- 
izontal position between the new tenth point and the eleventh point which he had pre- 
dicted. The process was then repeated. The time per prediction was fifteen seconds. 
Each trial lasted at least twenty minutes making for at least eighty predictions 
per trial. 

Eight subjects were used, four of which were well acquainted with system dyna- 
mics and optimal control *h11e the nearest acquaintance with the task of the other 
four was freshman calculus. They were Instructed to minimize &t$ prediction error. 

Each subject performed a randomly chosen sequence of eight trials. Each trial 
was characterized by an approximation to the normalized Integrated absolute auto- 
correlation function I given by 
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• variance of displayed signal. 


Equation (2) Is a measure of the “memory'' of the system or, in other words, it Is a 
measure of the confidence with which the next point can be predicted based solely on 
the Information contained in a limited number of past points. This measure is Inde- 
pendent of input variance. The Input variance was chosen so as to yield a constant 
output standard deviation^ of 100.0 (with a range of 1000.0). 

The results of the experiment are shown In Figure ?. It was assumed that the 
last sixty of the eighty-plus evictions represented a more or less steady-state 
(not necessarily non- tin- * behavior. Since there was no statistically sig- 
nificant difference bet. formance of those subjects familiar with system 

dynamics and those unfat lata shown 1$ across all eight subjects. Each 

value of the .^MS predict .» .. *1th respect to optimal represents an average 
across twenty prediction^ tor a particular subject. Thus, the data Includes three 
values of e^per subject per trial. Hence, o e Is a measure of the dispersion o' 
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average prediction errors. Since the performance of the models was measured In ex- 
actly the same way, this averaging of averages presents no problem. 

was 

The following models represent several approaches to describing human perform- 
ance In the above taste. They will only be discussed In general. The reader Is re- 
fcrvww to Rouse [ 5 ] for the derivations. 

While all five models vary to some degree, they all Include an observation noise 
parameter to account for the fact that a human observer cannot perfectly estimate the 
magnitudes of physical stlirull. This psychophysical phenomenon was formalized by the 
well-known Ueber-Fechner law and Its application to the observation of continuous time 
series has been experimentally investigated by Levlson, Baron, and Klelnman [ 3 ] and 
discussed by Crossman [ i ]. Specifically, the Idea 1$ applied here by assuming that 
the standard deviation o x of the hunan's estimate of a quantity x Is given by 

^x * F • constant. (3) 
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A very simple model Is that of linear extrapolation fr* the previous two points 
Vl * (x H * x »-1* 

where x Is the Injun's prediction. Since one-sided difference equations have been used 
to approximate derivative* t (4) r.an be written as 

Vi * *n * *n (5) 


A slightly more sophisticated model assumes that the human fits a second-order 
curve through the last three points and then extrapolates that curve to make Ms pre- 
diction. This can easily be shown to yield 

*n*i * *« ♦ ’n * *n (6) 

The RMS error between each of these models and the optimal was determined analyt- 
ically and Is shown In Figure 3. As can be seen, these models do not perform as 
well as the subjects. Increasing F above zero would only make matters worse. 

The simple ext rapo later models do not learn about the system from observing It. 
Their strategy Is fixed. We will now consider a model that collects data and then 

pe rforms a linear regression on that data to identify the system. This model Is 
termed a learning model because the qualify of the Identification Improves In time. 

The model learns more and more about the system as it collects more data. This de- 
finition of learning Is € Afferent from classical operent conditioning. The model 
gains nothing from Its mistakes. Learning Is considered here only in the sense of 
gaining Information from Its environment. 

The Teaming model makes predictions using 
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Figure 4 compares «»e turning nodel with th e exper lwental date. T|* 1 d £* for 
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to use an F of 1.0, 2.0, or higher. 
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The fallowing nodal 1* a discrete u rinlw t of Hwj nodel t 7 3. 
I the autocorrelation aodel and wake* predictions using 
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and 4 (lot) Is the e o tocorreletlu function. This nodel Is cenparnd with the «*- 
pJtil dote In Figure S. It does each better thaathu 

nU surprising slue the expansion of a few teens In the learning nodal («aj snows 
tanas such as y,,, V^2* eU ' 

The last nodal to bo considered Iso United nonary nodal Jf 
iMAivtd am similar to that of the learning model except that there Is • double- 
SSir uanerT uelghtlne function that effectively fdrgats old deco. This Is 
accoapllshad by changing (8a) to 
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nht r e U is a dlagoul square notrls with diagonal elenents sj gleu by 
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and D > 1.0 is a free parameter In the model. Computationally, It 1$ necessary to 
tnncate (12) In ortkr for W to be of finite order. !t was assumed that If < 0.10, 


then w| « 0.0. 


The limited memory model Is compared to the experimental data In Figure 6. The 
parameters of tie model were found bj fitting the data for the tr»al with lowest 1. 

The rrii of the trials were then run with the same parameters. This emphasizes the 
closeness of t~e fit of the model to data. 


The 0 of 2.5 leads to an effective m emo r y, length of thirteen. This means that 
the human uses thirteen past states to compute C. Once he calculates C, he uses only 
the present state to make his prediction. The state contains only three past points 
(assuming the human used the same derivative formulas as the model). The distinction 
between memory length and the length of the state vector Is Important. The htanan 
might very well decide that the state vector X need only be of length two or Wire* which 
right Include perhaps three or four past points depending on derivative approximations. 

However, when determining C, he should use as much past history as he can, (This as* 
sumes tnat the system Is stationary and he realizes that such Is the case.) Since the 

statistical quality of C Is a monotonlcally greeting function of memory length, the 
human has no reason to Tlmlt memory length. Thus, It Is Inferred that the effective 
memory length of thirteen found with the model Is not the result of the human purposely 
discounting the value of less recent data. 


mso ’ ION 


The ibove models Indicate that human prediction strategies are more sophlsvl- 
than simple extrapolations , but also, that humans are suboptlmal predictors. 

•c,e results do not agree with those of Ware [7] or those of Klelnman* Baron, 
on [?] who assume the human to be an optimal predictor. However .their tasks In* 
' human's motor system to a significant degree and because of this, delaya 
iromowor dynamics had to be Included as sources of suboptimality. Also, 

'vstem can have the positive effect of providing proprioceptive cues by the 
'or example, the arm-stick combination [4], These factors combined with 
at subjects in their tasks were making relatively short predictions, make 
of their results with those presented here a little difficult. 

V,*e other end of the prediction length scale, Sheridan and Rouse [6] have 
stud ct t»*n human ' 5 ability to predict several time units Into the future. As might 
be Intu • o, the human's performance ‘-ecomes Increasingly suboptlmal with prediction 

length. This behavior has been modeled [5] and the conclusion reached was that the 
human has difficulty determining the amount of signal history due to the noise Input. 

While this supports the proposition that limited memory constrains him from collecting 
sufficient data, applying the limited memory model to long prediction tasks yields un- 
satisfactory comparisons with the experimental data of Sheridan and Rouse, This pro- 
blem was further Investigated by performing a linear regression on the experimental data 
from which the parameters of the limited memory model were determined. The results of 
the regression were then used to estimate what the human might have done If he had 
been predicting further Into the future. These predictions were Inconsistent with 
Sheridan and Rouse's data In the same way that the limited memory model was Inconsistent. 


This seems to Indicate that some new source of suboptimality becomes significant 
with longer predictions. The optimal prediction trajectories for long predictions do 
not look very much like the actual time series. The optimal trajectory approaches the 
mean of the time series exponentially. Adopting an optimal-like strategy for long pre- 
dictions may require a conceptualization that humans find difficult to accept. 

By way of analogy, consider asking a human uninitiated In the laws of probability 
to predict tie flip of an unbiased coin. If the person Is Instructed to minimize pre- 
diction arror where heads ■ 1 and tails » 0, the optimal strategy Is to predict the ex- 
pected vilue of 1/2. However, anyone who has Instructed beglnnir" students of prob- 
ability, knows the difficulty of convincing a percentage of the students that the ex- 
cepted vOue of the above coin flip Is 1/2. Usually some student will wonder how 1/2 
can be tie expected value * i In actuality a flip can only yield tha values of 0 or ). 

tt seems reasonable to assign such conceptual difficulties to the cooMtive cat- 
egory. With this assignment, Figure 7 summarizes the relative significance of physi- 
ological and cognitive constraints on the human's ability to predict. Reaction time 
and neuromotor dynamics are not constraints (and propiocept1*e cues are not aids) when 
making long predictions. Cognitive constraints are not very significant (relative to 
other constraints) for short, fast predictions but Increase In significance as the pre- 
diction length increases. 
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